Bayesian feedback control of a two-atom spin-state in an atom-cavity system 
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We experimentally demonstrate real-time feedback control of the joint spin-state of two neutral 
Caesium atoms inside a high finesse optical cavity. The quantum states are discriminated by their 
different cavity transmission levels. A Bayesian update formalism is used to estimate state occupa- 
tion probabilities as well as transition rates. We stabilize the balanced two-atom mixed state, which 
is deterministically inaccessible, via feedback control and find very good agreement with Monte- 
Carlo simulations. On average, the feedback loops achieves near optimal conditions by steering the 
system to the target state marginally exceeding the time to retrieve information about its state. 

PACS numbers: 37.20.+i, 42.50.Lc, 42.50.Pq 



Controlled quantum systems based on neutral atoms or 
ions and involving multiple particles are providing an ex- 
perimental platform for the preparation and application 
of non-classical quantum states pQ. With such systems, 
for instance, light can be shed onto non-trivial quantum 
correlations governing the dynamics of many-body sys- 
tems [2]. Tight control over all external (motional) and 
internal (spin) degrees of freedom is needed to approach 
unitary evolution of the experimental system, which is 
the main challenge from the single to the multi particle 
level. 

Passive stabilization of the experimental system is an 
obvious requirement, e.g. isolation against environmen- 
tal perturbations. More recently, also active feedback 
loops are playing an increasing role in stabilizing and 
preparing quantum states on a time scale longer than 
the decoherence time [3] . Closed loop control is based on 
a combination of information retrieval (measurements), 
a controller, and actuators to drive the system towards 
the desired state. The loop delay time must be short 
compared to the typical fluctuation time scales of the 
system. Fast quantum measurements without strong dis- 
turbance of the system, however, typically yield noisy re- 
sults. Thus it is mandatory to employ real-time methods 
for the analysis of noisy signals. Experimental advances 
are aided by the increasing availability of fast and pow- 
erful digital signal processors. 

A proposal by Balykin and Lethokhov [3] called a feed- 
back method "information cooling" for motional control 
of atoms, emphasizing the close connection of informa- 
tion and control. Feedback control leading to cooling was 
recently realized [6] with atoms strongly coupled to a 
high-finesse optical resonator. The method is successful 
at the single particle level in the strong coupling limit 
of cavity-QED: The transmission of the optical resonator 
allows real-time monitoring of the atomic position and 
motional control via modulation of a trapping potential. 

Here, in contrast, we focus on feedback onto the in- 



ternal atomic state. The projective measurement of the 
joint internal pseudo-spin state via the cavity transmis- 
sion level has been proposed for the probabilistic cre- 
ation of multi-atom entanglement [7]. As a first step 
towards this goal, we experimentally discriminate the 
joint discrete two-atom quantum states p a =o = |ll)(44|, 

p a=1 = i/2(|nXn| + lltXItl) and a =2 = |ttXtt|, ^ere 
a corresponds to the number of atoms in the spin up 
state. Our aim is to stabilize the balanced mixed state 
p a =i by applying a feedback based on an Bayesian up- 
date algorithm [5]: We assign time-dependent probabili- 
ties p a (t) to the states p a and use the measured photon 
count-rate n(t) of the cavity transmission to determine 
the conditional probabilities after photon detection ac- 
cording to Bayes' theorem [9J. This concept allows in 
principle to optimally extract the information carried by 
every measured photon. 

In our experiment, the pseudo-spin states are imple- 
mented by the two long-lived hyperfine ground states 
\F = 3) = ||) and \F = 4) = |f) of Caesium. We trap 
two laser-cooled Cs atoms inside a high finesse optical 
cavity using a far off-resonant standing wave dipole trap, 
see Fig. [lja) (TU1 E] . The cavity resonance frequency is 
blue detuned from the F = 4 — » F' = 5 transition of the 
Cs D 2 -line and is on resonance with the frequency of a 
weak probe laser, see Fig. [ljb). 

The detuning of the cavity from the atomic resonance 
and the position of atoms inside the cavity mode are 
optimized to achieve long storage times of the atoms 
and maximally spaced transmission levels: The two-atom 
states /3 a — 0,12 reduce the probe laser transmission by 
0%, 30%, 60% to resolve the different atomic states with 
the highest contrast [5]. While the driving of the atom- 
cavity system by the probe laser allows us to continu- 
ously obtain information about the joint atom state via 
the transmitted light, the probe beam itself also induces 
spontaneous transitions p a =2(i) Pa=i(o) by inelastic 
Raman scattering at rates R21 (Rio), see Fig.[]Jc). 
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FIG. 1: (a) Schematic of experimental setup, (b) Simplified 
level scheme of Cs, (c) two-atom states and transition rates of 
probe (R21R10), repumping (Rr) and depumping (Rd) laser 



The cavity transmission is measured by a single pho- 
ton counter [Til] which is connected to a digital signal 
processor controlling the intensities of both a repumping 
laser (rate R T , F = 3 — > F = 4) and a depumping laser 
(rate Rd, F = 4 — > F = 3) in real-time, see Fig. [I] 

To exclude atom losses during the experiment, we de- 
termine the number of atoms via fluorescence at the be- 
ginning and the end of each experimental sequence and 
we measure the cavity transmission after optical pumping 
to p Q= 2 at the end to exclude positioning errors leading 
to bad coupling. 

For the estimation of the rates we choose continuous 
weak repumping laser intensities (Rd = 0, R T ~ Rio), at 
which we observe abrupt state changes called quantum 
jumps as shown in Fig. [2ja) [8]. 

We estimate the state of the system by assigning oc- 
cupation probabilities p(t) — (po(t),Pi(t),P2(t)) T to the 
states p a . At discrete times spaced by the bin time At 
we determine the number of transmitted photons n(ti). 
Application of Bayes' theorem [9] yields a posteriori state 
probabilities from a priori probabilities p prl (£j), 



p(a\n(U)) 



(1) 



based on the distribution of conditional probabilities 
p(n\a) for the same bin time, which are known from sepa- 
rately measured photon count rate histograms for exactly 
0, 1,2 atoms coupled to the cavity, see right diagram in 
Fig. [2j With no further information available the a poste- 
riori probabilities would become the a priori probabili- 
ties for the following measurement, p post (ii) — > p prl (ii+i) 
. This procedure can be interpreted as repeated updat- 
ing of our knowledge about the state of the system based 
on the measured number of photons n(ti). The initial a 
priori probabilities p prl (£o) = (0,0, 1) T are assigned ac- 
cording to the state p a =2 pepared by optical pumping at 
the beginning of each experimental sequence. 

The average evolution of our system is described by 
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FIG. 2: (a) Transmission of the probe laser and photon count 
histograms, (b) estimated state probabilities for weakly re- 
pumped two- atom states for a bin time of At — 1 ms, and (c) 
evolution of the rate probabilities. 



rate equations. Thus we can further improve our know- 
ledge of the a priori system state at time t i+1 by taking 
into account the evolution from the previous a posteriori 
system state p post (ti). For weak continuous repumping 
(rates {Rj} = {R 2 i,R w ,R I } < At" 1 , Fig. Qc)) the 
linearized solution is 



P pii (U+i) = 
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where 1 is the 3x3 identity matrix. 

The model implemented by Eq. |2]) allows to extend 
Bayes' theorem to generalized probabilities p(a, {Rj}) for 
states and rates, overcoming the need to determine {Rj} 
by an independent measurement: 

pP° st (a,{R J }\n(t))^p(n(t)\a)p^(a,{R J }). (3) 

The photon count histograms p(n\a) are not directly af- 
fected by the rates if {Rj} -C At^ 1 . Nevertheless, ev- 
ery measurement n(ti) provides information about the 
rates since Eq. [2] updates our knowledge by predicting 
an a priori distribution for the generalized probabilities 
p^(a,{R }). 

We take an initally flat probability distribution (no 
knowledge) for the rates and evaluate the probabilities 
on a discrete grid in the four dimensional space of states 
and rates for each measurement n(ti). The probability 
values for any rates or states alone can be calculated 
using the marginalization rule, e.g. 



P post (a\n(t)) 



J2p poat (<*,{Ri}Ht)) 
{R 3 } 



(4) 



An example of the time evolution of a free running, 
weakly repumped system is given in Fig. |] (b) for the 
state probabilities p a and in (c) for the distribution of 
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FIG. 3: (a) Transmission of the probe laser and transmis- 
sion histograms of (blue), 1 (green) and 2 (red) coupled 
atoms and current transmission signal (black). The red and 
blue lines indicate the incidence of repumping and depumping 
feedback pulses, respectively. Note that the histogram of the 
current trace resembles the histogram of one coupled atom to 
a very high degree, (b) Estimated state probabilities for feed- 
back onto the two-atom state p a =i ■ A bin time of At = 1 ms 
has been used for all subfigures. 



rates i?io and R21 where, with increasing data accumu- 
lation (information gain), a narrow peak emerges. The 
transition rates and errors are extracted as the expecta- 
tion values and the rms values of the probability dis- 
tribution. We stop data acquisition when the uncer- 
tainty of the transition rates is 10% yielding rates 
i?io=(50±6)s- 1 , R 2 i=(35±4) s- 1 and i? r =(59±5) s"\ 
where 5.1s of data acquisition corresponding to ~ 250 
quantum jumps were used as an improvement with a sig- 
nificantly lower number of quantum jumps compared to 

Theoretically, the Bayesian data analysis is indepen- 
dent of the choice of bin time for Ai^i?" 1 for shot noise 
limited signals. Experimentally, the analysis yields con- 
stant rates in the range of At=0.3 ms ... 10 ms. Below 
Ai=0.3ms we observe an increase of the extracted tran- 
sition rates due to a super-poissonian broadening of the 
photon count histograms p(n(At)\a) |8j. We attribute 
this broadening to atom-cavity coupling fluctuations in- 
duced by atomic motion. They cause correlations not 
accounted for by the Bayesian state estimation, which 
leads to noise affecting the rate estimation. They are 
more relevant at short bin times where the photon num- 
ber distributions p(n(At)\a) are not well separated. We 
have thus chosen a bin time of At = 1 ms which maintains 
high time resolution while providing acceptable separa- 
tion of the photon count histograms. Before closing the 
feedback loop we measure the photon count histograms 
and determine the rates i?2i,-Rio according to Eq. Q. 

In order to steer the system towards the target state 
p a =i we continuously monitor the cavity transmission 
and use Eqs. ([!]) and |2| for real-time state estimation. 
The algorithm controlling the application of short, in- 
tense pulses of repumping and depumping laser light 
minimizes the Kolmogorov distance fc(p targot , p(t)) = 
\^l a |PQ arsct— Pa(t)\ which quantitatively measures the 
difference of the estimated time-dependent probabilities 



from the target state. 

The short laser pulses drive state changes with transi- 
tion probabilities T rjC j during a single pulse of length St. 
This knowledge is included in our algorithm by multiply- 
ing pP ost (£) with a matrix 

/ (1 - T r ) 2 0\ 
M r = 2T r (l-T r ) 1-T r (5) 

for a repumping laser pulse and accordingly Md for 
a depumping pulse. The optimal transition probabil- 
ities can then be calculated by minimizing the Kol- 
mogorov distance fc(ptar g ct, Mjp post (i)) with respect to 
Ti. Here, the optimal Ti depend on p(t) and lie within a 
range of [0.25, 0.5] per pulse. However, simulations show 
that the mean occupation of the target state does not 
change significantly if the algorithm is simplified as fol- 
lows: We use a fixed value of T r (Td) and apply a re- 
pumping (depumping) laser pulse if pa(t) > pi(t),p2(t) 
(P2{t) > Po(t),Pi(t)), respectively. Since this feedback 
method is less demanding to be technically implemented, 
we have experimentally set T r( j to values that maximize 
the estimated probability of the target state by fixing 
the length of the pulses to St « 1.5 us and optimizing its 
intensity. The computation of the closed feedback loop 
algorithm takes a time of about 6 us on our digital sig- 
nal processor (TMS6713 by Texas Instruments) and can 
thus be neglected with respect to the update frequency 
of 1 ms -1 . 

A typical measurement of the probe transmission with 
feedback is plotted in Fig. [3j The red and blue vertical 
lines in the background of the transmission data indi- 
cate a repumping (red) and depumping (blue) laser pulse. 
The random telegraph pattern of the quantum jumps is 
strongly suppressed and the state probabilities are domi- 
nated bypi. Furthermore, the photon-count histogram of 
the experimental feedback trace (black) is almost identi- 
cal with the photon count histogram of a single coupled 
atom (a = 1, green), confirming the reliability of our 
state estimation and feedback scheme. In principle an 
out-of-loop measurement of the atomic states could be 
performed via a push-out technique [12]. 

The mean probability of the target state p a =i over 
many experiments is (pi° st (i)) t = 84%, see Fig. [ijja). 
This is in excellent agreement with a Monte-Carlo sim- 
ulation of the feedback based on the measured rates 
R2l^ Rio arL d the measured photon count rate histograms 
p{n(t)\a). The scheme is also capable of stabilizing the 
states /5 Q= o.2i but these states are trivially accessible by 
optical pumping. 

The time constant for the atom-cavity-system to stay 
in p a= i is determined to be r = (19 ± 2) ms ~ l/i?io, in 
full agreement with the prediction by the rate equations: 
The mean time in state a = 1 is ultimately limited by 
inelastic scattering of the probe laser with rate Rio yield- 
ing a probability of 1 — Rio At to stay in this state during 
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FIG. 4: Comparison of mean probabilities for the case of 
feedback (a) and continuous weak repumping experiments for 
measured (c) and optimal repumping rate (b). The shaded 
bars indicate simulated results, (d) Analytical solution of the 
mean probabilities for different repumping rates R T . 



are indistinguishable by our projective transmission mea- 
surement. However, the \^~) state is the only eigenstate 
of a successive application of a common ir/2 single qubit 
rotation of both atoms and the transmission measure- 
ment with a transmission level of a = 1. Any contri- 
bution from will be projected onto the the states 
Pa=o(2) after sufficient number of repetitions. Thus a fu- 
ture feedback algorithm might utilize this measurement 
scheme to detect and purify the entangled state \^~) and 
to restore it in case of p a =o(2)- F° r this we would cre- 
ate \^} + according to a probabilistic scheme proposed by 
S0rensen and M0lmer [7] and convert to |\& _ ) with 
a differential phase shift between the two atoms, e.g. by 
a magnetic field gradient. 
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a time bin At. The effectivity of the feedback loop is 
characterized by the time constant until the target state 
is reached which is experimentally given by 1.12 ms and 
thus near the theoretical optimum of a single time bin. 
The slightly larger mean probability of the lowest state 
p a =o compared to p a =2, visible in Fig. [IJ(a), is caused 
by the depumping due to the probe laser. 

Without feedback the highest passively achievable 
mean probability of the target state p a =i is 50% for sat- 
urating repumping and depumping lasers. In this limit, 
the pumping lasers dominate the system dynamics and 
cause very high transition rates. In a more appropriate 
case of a weak continuous repumping laser (i? r = 59 s -1 ) 
we have experimentally determined the mean probability 
(p p 1 ost (t)) t = 33%, see Fig.gc). The solution of Eq. m 
for traces of 300 ms length under the same initial condi- 
tion of p(0) = (0, 0, 1) T depending on the repumping rate 
R r yields the expected mean probability as a function of 
i? r , see Fig. |4]Jd). Even at an optimal repumping rate, 
the mean target state probability never exceeds 37%, see 
Fig.gb). 

In order to increase the mean target state probability 
of our feedback scheme we would have to improve the 
probability 1 — i? 10 At to stay in the target state during 
a time bin. With an enhanced detection efficiency of 
the transmitted light we would be able to reduce the bin 
time. A higher single atom cooperativity would permit 
to further enhance the cavity-atom detuning for reducing 
Rqi. 

The stabilized mixed state p a= \ is a statistical mix- 
ture of the two Bell states I**) = (|tl)±|lt))/\/2, which 
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